"The highlighted tokens are primarily Korean grammatical particles, verb endings, and noun suffixes, as well as some content words and punctuation. These tokens often serve as key syntactic or morphological markers in Korean, indicating case, tense, subject, object, or other grammatical relationships, and are essential for sentence structure and meaning. Some non-Korean examples show similar emphasis on function words, endings, or connectors in other languages."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.63 | 0.76 | 0.38 | 0.507 | 0.38 | 0.88 | 0.12 | 0.62 |
fuzz | 0.57 | 0.548 | 0.8 | 0.65 | 0.8 | 0.34 | 0.66 | 0.2 |